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Abstract 

We consider a stationary Mean Field Games system defined on a network. 
In this framework, the transition conditions at the vertices play a crucial role: 
the ones here considered are based on the optimal control interpretation of 
the problem. We prove separately the well-posedness for each of the two 
equations composing the system. Finally, we prove existence and uniqueness 
of the solution of the Mean Field Games system. 
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1 Introduction 

The theory of Mean Field Games (briefly, MFG) has been introdnced in [201 |2l] 
to describe the asymptotic behavior of stochastic differential game problems (Nash 
eqnilibria) as the nnmber of players tends to +oo. /^From a mathematical point 
of view, MFG theory leads to the stndy of a conpled system of two differential 
eqnations: one eqnation is of Hamilton-Jacobi-Bellman (briefly, HJB) type and it 
describes the optimal behavior of the single agent, while the other one is a Fokker- 
Planck (briefly, FP) eqnation governing the distribntion of the overall popnlation. 
The system can be completed with different bonndary conditions (periodic. Dirich- 
let, Nenmann) and initial conditions (initial-terminal condition, planning prob¬ 
lem). Existence and nniqueness of strong and weak solntions to the MFG system 
have been obtained nnder rather general assnmptions on the data of the problems 

Aim of this note is to stndy MFG systems dehned on a network. While the 
differential eqnations are dehned in the nsnal way along the edges, a crncial issne is 
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to find the correct conditions at the vertices {transition conditions). We will choose 
a set of transition conditions according to the optimal control interpretation of the 
system. 

Starting with the seminal paper by Lumer a general theory for linear and 
semilinear differential equations on networks has been developed mainly employing 
the variational structure of the problem. In this framework the natural transition 
conditions are, besides the continuity of the solution, the so-called Kirchhoff condi¬ 
tions on the hrst order derivatives (see [23112311251 ES])- 

For a single nonlinear equation, existence and uniqueness results are available 
only for some specihc classes of operators such as conservation law [n] and some 
Hamilton-Jacobi equations [7]. Therefore the hrst step in our analysis is to establish 
existence and uniqueness results for each of the two equations composing the MFG 
system on the network. Because of its control theoretic interpretation (see [Hill] 
and Section 12]) the natural transition condition for the HJB equation is the Kirchhoff 
condition, while for the FP equation it is natural to require the conservation of the 
hux at the vertices. In Section [2] we discuss the relationship between the transition 
conditions for the two equations. 

After having solved the two equations separately, we tackle our second and 
main issue: the study of the MFG system on a network. We shall obtain existence 
of a solution by a hxed point argument; moreover we shall get uniqueness of the 
solution adapting a classical argument to this framework and taking advantage of 
the relation between the transition conditions of the two equations. 

As far as we know, this is the hrst paper to consider general MFG systems (HJB 
equation and FP equation as well) on networks. Indeed, in [B] only a particular class 
of MFG systems on networks was addressed; in that setting, by a suitable change 
of variables, the HJB and the FP equation are transformed in two heat equations 
both with Kirchhoff transition conditions coupled via the initial data. Moreover, 
it is worth to observe that the papers [IB], [IS] and HI consider MFG systems on 
graphs (namely, the state variable belongs to a discrete set). 

We remark that the results here contained can be generalized in several direc¬ 
tions (nonlocal coupling, evolutive problems, boundary conditions, weak solutions, 
ramihed spaces etc); moreover the assumptions are far from being optimal. Since 
this is a hrst approach to the study of MFG systems on networks, we have tried to 
keep the presentation as simple as possible in order to avoid technical complications 
and to concentrate on the network aspects of the problems. 

The paper is organized as follows. In the rest of this section, we shall introduce 
the dehnition of networks. In Section |2] we give a formal derivation of MFG systems 
on networks and, especially, of the transition conditions. Section |3] is devoted to our 
main results for the HJB equation, the FP equation and, mainly, the MFG system. 
Finally, in the Appendix]^ we collect some technical results. 


Networks. The network F = (V, S) is a hnite collection of points V := {vi}i^i 
in M"" connected by continuous, non self-intersecting edges S := {ej}j^j. Each edge 
Cj G is parametrized by a smooth function tij : [0, Ij] —)■ M”, Ij > 0. Given Vi G V, 
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we denote by InCi := {j G J : G Cj} the set of edges branching out from Vi and 
by dy^ := |/ncj| the degree of Vi. A vertex Vi is said a boundary vertex if dy^ = 1, 
otherwise it is said a transition vertex. For simplicity, in this paper we will assume 
that the set of boundary vertices is empty. 

For a function m : F —)■ M we denote by Uj : [0, Ij] —)■ M the restriction of u to 
Cj, i.e. u{x) = Uj{y) for x G ej, y = 7i~^{x), and by dju{vi) the oriented derivative 
of u at Vi along the arc ej dehned by 


f \imh^o+{uj{h) - Uj{0))/h, if Vi = 7rj(0); 

\ limh^o+-h) - Uj{lj))/h, if Vi = Tijilj). 


The integral of a function m on F is dehned by 


u{x)dx := / Uj{r)dr. 


The space T^(F), p > 1, is the set of functions m : F —)■ R such that Uj G L^(0,/j) 
for all j ^ J and ||m||p ;= J2j&j\Wj\\Lp{o,ij) < oo. For p > 1 and for an integer 
m > 0, we dehne the Sobolev space hF"^’^(F) as the space of continuous functions on 
F such that Uj G hF™'’^(0,Zj) for all j G J and ||M||m,p := < oo- 

As usual we set Fr^(F) := hF*^’^(F), fc G N. The space C^(F), /c G N, consists 
of all the continuous functions m : F ^ R such that Uj G C^{[0,lj]) for j E J 
and IIMlie* = max^<fc ||c?^m||i,oo < oo. Observe that no continuity condition at the 
vertices is prescribed for the derivatives neither for a function u G hF™’^(F) nor for 
a function u G 0*^(F). 

Finally the space 0^’"(F), for A; G M and a G (0,1), is the space of functions 
u G 0*^(F) such that d’^Uj G Ij]) for any j G J with the norm 

llwllefc.a := ||m||c* + sup sup [\d^Uj{x) — d^Uj{y)\/\x — ?/|"]. 

jGJ x,ye[0,lj] 


2 A formal derivation of the MFG system 

The MFG system can be deduced from two different points of view (see ISl) : either 
as the characterization of a Pareto equilibrium for dynamic games with a large 
number of (indistinguishable) players; or as the optimality conditions for an optimal 
control problem whose dynamic is governed by a PDF. We explain the two different 
points of view for MFG systems on networks showing that they lead to the same 
transition conditions. 

Pareto equilibrium: Gonsider a population of indistinguishable agents, dis¬ 
tributed at time t = 0 according to the probability mo; any agent moves on a net¬ 
work F and its dynamics inside the edge Oj is governed by the stochastic differential 
equation 

dXs = - 7 s ds dWs, 
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where 7 is the control, Vj > 0 and Wt is a l-dimensional Brownian motion. When 
the agent reaches a vertex Vi G V, it almost surely spends zero time at Vi and enters 
in one of the incident edges, say Cj with j G Inci, with probability (3ij where 


I3ij > 0 , ^ I3ij = 1 . 

j£lnci 

(see psun] for a rigorous dehnition of stochastic processes on networks). The cost 
criterion is given by 

rT 


Et 


{L(W, 7 i) + V[m{Xt)]}dt + V^[m{XT)] 




where m represents the distribution of the overall population of players. A formal 
application of the dynamic programming principle gives that the value function u 
of the previous control problem satishes 

—Ut — + Hj{x, du) = ld[m], {x, t) G Cj x (0, T), j ^ J 

Eje/nc. aijUjdju{vi, t)=0 {v^, t) G V x (0, T), 

Uj{vi, t) = Uk{vi, t), j, k G InCi, {vi, t) eV x (0, T), 

u{x,T) = Vo[m(T)], xGT 

where aij := and the Hamiltonian is given on the edge by 

Hj(x,p)=sup [- 7 -p-Lj(a:, 7 )]. 
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Note that the differential equation inside Cj is dehned in terms of the coordinate 
parametrizing the edge. The second equation in fl2.ip is known as the Kirchhoff 
transition condition and it is consequence of the assumption on the behavior of Xt 
at the vertices (see [E]). The third line amounts to the continuity at transition 
vertices. 

In order to derive the equation satished by the distribution m of the agents, 
we follow a duality argument. Consider the linearized Hamilton-Jacobi equation 

—Wt — 1 'd‘^w + dpH{x, du)dw = 0, (x, t) G Cj x (0, T), j E J 

t) = 0 {Vi, t) eVx (0, T) 

Wj{vi,t) = Wk{vi,t), j,k e InCi, {vi,t) eV X {0,T), 

w{x, T) = 0 X G T 

Writing the weak formulation of fl2.2p for a test function m, integrating by parts 
along each edge and regrouping the boundary terms corresponding to the same 
vertex Xj, we get 

0 = / / [ — Wt — Ujd^w + dpHj{x, du)dw)mdxdt 

J Jo Je^ 


3&J 

E 

76 J 
rT 


E 


[wm]^dx + J J [rrit — — d{mdpHj{x, 9m))] w dxdt^ 

Ujmj{vi, t)djw{vi, t) - [ujdjm^Vi, t) + dpH{vi, du)mj{vi, t))w{vi, t) 


ViSV U^Inci 


dt. 
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By the previous identity we obtain that m satishes inside the edges the equation 

rrit — — d{m dpH{x, du)) = 0. 

Moreover, recalling the transition condition for w, the hrst one of the three terms 
computed at the transition vertices vanishes if 

mk{vi,t) 


Oli 


j,k G Inci, {vi,t) e V X (0,T). 


(2.3) 


^ik 

The vanishing of the other two terms for each Vi G V, namely 

^ Ujdjm{vi, t) + dpH{vi, du)mj{vi, t) = 0, (2.4) 

j£lnci 

gives the transition condition for m at the vertices Vt G V. Note that fl2.4p gives the 
conservation of the total flux of the density m at the vertex Vi (see [m for a similar 
condition). Summarizing, for z/ := {z/jljgj, we get the system 

' — Ut — ud'^u + H{x, Du) = V[m\ {x, t) G T x (0, T) 

rrit — ud^m — d{m dpH(x, du)) = 0 (x, t) G T x (0, T) 


aiji'jdju{vi,t) = 0 


jGinci 

Ujdjm^Viyt) + dpH{vi,du)mj{vi,t) = 0 

j^Inci 


{Vi,t) G V X (0,T) 
{Vi,t) G V X (0,T) 


/X /X mAviD) mk(vi,t) , , ^ , X 

Uj{vi, t) = Uk{vi, t), -= —-- j, A; G JnCi, (n*, t) G V x (0, T) 


Oli 


^ik 


u{x,T) = Vo[m{T)], m{x,0) = mo{x) xgT 

(2.5) 

with the normalization condition Jj^m{x)dx = 1. The transition conditions (conti¬ 
nuity and either Kirchhoff condition or conservation of total flux) for u and m give 
dy. linear conditions for each functions at a Uj G V, hence they univocally determine 
the values Uj{vi,t) and mj{vi,t), j G JnCj. 

Optimal control: We consider the planning problem for a MFG system, i.e. we 
prescribe the initial and the terminal condition for the distribution m (see nuzn). 
Consider the functional 

pT r 


inf 

b,m 


{L{x, b)m + W[m]}dxdt 


( 2 . 6 ) 


subject to 

mt — — d{hm) = 0 

Ujdjm{vi, t) + b{vi, t)mj{vi, t) = 0 

jGinci 

mj{vi,t) _ mk{vi,t) 


a 




^ik 


m(x, 0) = mo(x), m{x,T) = mT^x), 


(x, f) G T X (0, T) 
{vi,t) G V X (0,T) 

(Ui, f) G V X (0, T) j, k G JnCi, 

X G T. 


(2.7) 
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The problem of minimizing fl2.6p under the constraints fl2.7p is equivalent to 


inf sup / / {L{x, h)m + W[m\ — u{mt — ud'^m — d{mb))}dxdt (2.8) 

u Jo Jr 

where u is the multiplier. We argue as in [H section 3.3] (see also [151 section 2.5.1]); 
integrating by part in 02.81) . taking into account the transition conditions in 02.71) 
and minimizing with respect to b, we obtain a minimum problem whose optimality 
conditions give, at a formal level, a system similar to 02. 5 p with an initial-terminal 
condition for m with V = W. 


Similar considerations in both the approaches can be used for deriving the 
stationary {ergodic) MFG system 


' — 1 /d‘^u -I- H{x, du) + p = V[m] 
ud'^m + d{mdpH{x, du)) = 0 
= 0 


j£lnci 


[jyjdjm{vi) + dpHj{vi,dju)mj{vi)] = 0 

j£lnci 

.X .X rrijivi) rrikivi) 

Uj{Vi) = Uk{Vi), - 


Of?; 


^ik 


X eT 
X eT 

VieV 

GeV 

j, k G /ncj, Vi eV 


(2,9) 


I u{x)dx = 0, J m{x)dx = 1 


where p G M is also an unknown. 

In the rest of the paper we will only consider the stationary system 02.9p . 
Moreover we will restrict to the case in which all the coefficients in the transition 
condition for u are equal, i.e. 


aij = ttik Vi G I, j, k G JnCj. (2.10) 

If O2.10p is not satished, the function m should be discontinuous at Vi and this fact 
clearly involves additional difficulties. In fact it is well known that, in its standard 
dehnition, the domain of the Laplace operator on a network is given by the 77^ (T) 
functions (in particular, continuous) satisfying Kirchhoff condition at the vertices 
(HIES). Moreover, the continuity condition at transition vertices seems to be a 
crucial ingredient for the comparison principle (see [2^ [21] ). 


3 Main results 

This section contains our main results on the solvability of HJB equations, FP 
equations and, above all, MFG systems on networks. To this end, we hrst introduce 
some assumptions. Gonsider an Hamiltonian 77 : F x M —)■ M, namely a collection 
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of operators {Hj)j^j with Hj : [0, Ij] x M —)■ M. For some 6 and C positive numbers, 
we assume 


e X M); (3.1) 

{x, •) is convex in p for each x G [0, Ij]; (3.2) 

S\p\‘^ — C < Hj{x,p) < C\p\‘^ + C for (x,p) G [0,/j] X M; (3.3) 

u = {i>j}j^j, Uj G M with 0 < 1^0 •= inf (3-4) 


These assumptions will hold throughout this paper unless it is explicitly assumed 
in a different way. Let us note that no continuity condition for H is required at the 
vertices and that, clearly, also the diffusion v may present discontinuities at these 
points. 

Let us now state our result for MFG systems, whose proof is contained in 
Section 13.31 in Sections 13.11 and 13.21 we shall establish our result for HJB equations 
and respectively for FP equations. 


Theorem 3.1 Assume fl3.ip - fl3.4p and that V is a local coupling, namely 
V[m]{x) = V{m{x)) with V G (^^([O,+oo)). 

Then, there exists a solution {u,m,p) G G^(F) x G^(F) x R to 
' —ud^u + H{x, du) + p = V[m] 


ud'^m + d{m dpH{x,du)) = 0 

UjdjU^Vi) = 0 

j£lnci 

[iyjdjm{vi) + dpHj{vi,dju)mj{vi)] = 0 

j£lnci 

Uj{vi) = Uk{vi), = mk{vi) j, k G InCi, n* G V 


a; G F 
a; G F 

Vi^V 
GG V 


I u{x)dx = 0, j m{x)dx = 1, m > 0. 


(3.6) 


(3,6) 


Moreover if 


{y[mi\ — V[m2\){rni — m2)dx < 0 ^ mi = m 2 . 


(3.7) 


then the solution is unique. 


Remark 3.1 As already pointed out in the introduction, this result can be easily 
adapted to the case of networks having a boundary by imposing Neumann or Dirichlet 
boundary condition. 
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3.1 On the Hamilton-Jacobi-Bellman equation 

This section is devoted to the ergodic HJB problem: find {u, p) G (7^(1) x M such 
that 

{ —vd'^u + H{x, du) + p = f{x), a; e r 

Uj{vi) = Uk{vi), Ujdju{vi) = 0 j,kElnCi, n* G V (2-^) 

jelnci 

with the normalization condition 

J u{x)dx = 0. (3.9) 

Theorem 3.2 Assume fl3.ip - fl3.4p and f G for some a G (0,1). Then, 

there exists a unique couple {u, p) G C'^(r) x M satisfying fl3.8p - 03.91) . Moreover 
u G C^’"(r) and there holds 


||M||c 2 .“(r) < <7, IpI < max |il(-,0) -/(•)! (3.10) 

with C depending only on ||/||(:;o.c and the constants in fl3.3p - 03.4p . 

Proof Proposition lA.ll ensures that, for any A G (0,1), there exists a solution 
ux G ^^-“(r) to 

f —i'd‘^u + H{x,du) + Xu = f{x), a; G r (3 11) 

I Uj{vi) = Uk{vi), Y^jainci =0 j,k E InCi, n* G V. 

We want to pass to the limit for A —)■ 0 in 03.lip . We first observe that if Co is 
a constant such that maxr |il(-,0) — /(•)! < Cq, then the functions u, u defined 
by m(x) = —Co/A, u{x) = Cq/\ for any x G P, are respectively a sub- and a 
supersolution of 03.111) . By Proposition IA.2I we get 

— Co < \u\{x) < Co for any x G P. (3-12) 

Now, let us introduce the function w\ := u\ — minr^A; it is a C^’" solution to 

— vd‘^wx + H (x, dwx) + Xux = /(x) x G P (3.13) 

with the same continuity and Kirchhoff transition conditions as in 03.111) . We claim 

||^R'A||L2(r) < Cl (3.14) 

for some constant Ci depending only on ||/||c 70 ,a and the constants in 03.3l) - 03.4p (in 
particular, independent of A). Indeed, integrating equation 03.13P on P (i.e. using 
0 = 1 as test function for wx), we get 


H{x, dwx) dx+ (Xux) dx = f dx. 



















By assumption fl3.3p and estimate fl3.12p . we infer 


5 [ \dwx\^dx< [{C-\ux + f)dx<{C + Co + \\f\U\r 


Jr Jr 


which amounts to our claim fl3.14l) . We claim now that 


'?^A|lc2'“(r) < C2 


(3.15) 


for some constant C 2 with the same feature of Ci. To this end, we note that, since 
wx is a classical solution to fl3.13p . by fl3.3p - fl3.4p and fl3.12p . there holds 


J^o\d‘^u!x\ < \H{x,dwx) \ + |Ama| < C{\dwx\^ + 1) + Cq 


and, by 03.141) 


ll^^'M^AlUpr) < C3 


(3.16) 


for some constant C 3 sharing the same features of Ci. Taking into account 03.141) 
and 03.16p . (possibly increasing C 3 ) we infer ||5tCA||cO’“(r) < C 3 ; using again 03.131) 
we accomplish the proof of our claim 03.15p . 

Possibly passing to a subsequence, we may assume that, as A —>■ O'*", the 
sequence {tCA}A converges to some function u G C^’“(r) (observe that u still verihes 
the continuity and the Kirchhoff conditions) and that {AminrUAjA converges to 
some constant p. Passing to the limit in 03.13p . we get that the couple (u, p) satishes 
03.81) . Possibly adding a constant to u, we also get 03.9p . 

To show the uniqueness of p, assume that there exist two solutions («*, pi), i = 1, 2, 
of 03.8p and let xq be a maximum point of ui — U 2 - If xq G e^, we have djUi^xo) = 
djU 2 {xQ) and cI|mi(xo) < cI|m 2 (xo)- Hence using the equation we conclude that p 2 < 
Pi- If Xq = Uj, there holds djUi^Xo) < djU 2 {xQ) for any j G Jncj. In fact, we have: 
djUi^Xo) = djU 2 {xo) for any j G Incp indeed, assuming by contradiction dkUi{xo) < 
djU 2 {xo) for some k G InCi, we get Zljg/nci < Sjg/nci ^i^i“ 2 (xo) which 

contradicts the Kirchhoff condition. Hence 

Ujd^j{u 2 - Ui){xo) > H{xo, djU 2 {xo)) - H{xo, djUi{xo)) + p 2 - pi = P 2 - pi 

which, together with djUi{xo) = djU 2 {xo), gives a contradiction for p 2 > pi- Hence 
P 2 < Pi and by symmetry P 2 = Pi- 

Having proved the uniqueness of p, the uniqueness of a solution to 03.8p - 03.9p can 
be proved as in [71 Corollary 3.1]. Finally, since there exists a unique solution to 
fl3.8p we conclude that all the sequence {wx, Xux) converges to {u,p). □ 

3.2 On the Fokker-Planck equation 

This section is devoted to the following problem 

+ d{h{x) m) = /(x) x G P 

mj{vi) = mk{vi), ^ [h{vi)mj{vi) + i'jdjm{vi)] =0 j, fc G JnCj, u* G V 

jGinci 


(3.17) 


9 
































with the normalization conditions 


m > 0, J m{x)dx = 1. (3.18) 

Definition 3.1 (i) A strong solution of 03.171) is a function m G C'^(r) which 

satisfies 03.17P in pointwise sense. 

(a) A weak solution of 03.171) is a function m G H^{T) such that 


/ {r'jdjm + b{x)m)dj(l)dx + / /0(ix = 0 V0 G i7^(r). (3.19) 


Remark 3.2 By standard arguments, one can easy check that if m E C'^(r) is a 
weak solution to 03.171) . then it is also a strong solution to 03.17p . 


Theorem 3.3 Assume b G C'^(r). Then, there exist a unigue weak solution m to 
03.17l) - 03.18p with / = 0 and it verifies 


ll’^llri'i ^ C, 0 < m{x) < C (3.20) 

where the constant C depends only on ||6||oo cind u. Moreover m G C'^(r) and it is 
also a strong solution to 03.17p . 

Proof We shall proceed adapting the arguments of [U Theorem II.4.3]. By 
Proposition IA.31 there exists a unique (up to multiplicative constant) solution to 
problem 03.171) . So we only have to prove that this family of solutions contains a 
(unique) function m satisfying 03.18p which moreover will verify O3.20p . 

For A G (1, +oo) and for any (f G L°°{T), we set 


U\{t, x) := U{\t, x) for {t, x) G (0,1) x F 

where U is the solution of the parabolic Cauchy problem 0A.15I) with -0 = 0 (see 
Lemma [A.2D . Observe that U\ solves 

dtUx - Xvd'^U + XbdU = 0 in (0,1) x F (3.21) 

with the same transition conditions and initial datum of OA.lSp . We claim that 

U\ are uniformly bounded in L^(0,1; fl L°°((0,1) x F). (3.22) 

Indeed, since ±||0||oo are respectively a super- and a subsolution to fl3.2ip . we get 


\Ux(t,x)\ < II 0 IIOO a.e. in (0,1) x F. (3.23) 


In other words, we get that the functions Ux are uniformly bounded in L°°((0,1) x F) 
and, in particular, in L^((0,1) x F). On the other hand, using Ux as test function 
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for problem fl3.2ip . we get 


/ Ul{T,x)dx + A z/j / / {djUxY dxdt 
Jr ■ J J {0,l)xej 


(j)^{x) dx — X 


hdUxUx dxdt 


(o,i)xr 


< / 0^(a;) dx + X\\b\\, 


\dUx\\Ux\dxdt. 


(o,i)xr 


Applying Cauchy inequality to the last term (recall that F has hnite measure), by 
03.231) . we get 



{djUxY dxdt < c{X + 1) 


for some constant c independent of A. We infer that dUx are uniformly bounded in 
L^((0,1) X r); thus our claim 03.22p is completely proved. 

The property 03.22p yields that there exists a subsequence of {Ux} (that we 
still denote by Ux) such that 


Ux ^ ^ in T°°((0,1) X F) weak-* and in T^(0,1; iF^(F)) weak as A ^ -|-cx). 


Let us now use (39 as test function for 03.2ip . with (3 G (^“((0,1)) and 6 G C'°°(F) 
(recall: this means that 9 G ^^(F) and 9 G C°°{ej) for every j E J)] we obtain 


[0,1] xr 


Ux(3'9dx dt+ (3 ^ / {i'jdjUxdj9 + bdjUx9) dx dt = 0. 


'[ 0 , 1 ] 


Passing to the limit as A —)■ +cx), we get 

f (3 ^ f {vjdj^dj9 + bdj^9) dx dt = 0. 

J[0,1] j Jej 

By the arbitrariness of (3 we get that, for a.e. t G (0,1), there holds 


f {ujdj^djd -]- bdj^9) dx = 0; 

J e-i 


namely, is a weak solution to 

+ b{x)d^ = 0 


a; G F 


= 0 ^ ^ Vi G V. 

jGinci 


The maximum principle for this problem (see Theorem 2.1]) ensures that the 
function ^ is independent of x, namely ^ = ^{t). 
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On the other hand, using the function m introduced in Proposition IA.3I as test 
function for fl3.21l) . we infer 


as A —)• +CX), we get 


I Ux{t, x)m{x) dx = J 4>{x)m{x) dx] 


^(t) J m{x) dx = j 4>{x)m{x)dx. 


By the arbitrariness of 0 (recall also that m cannot be identically zero because it 
belongs to a 1- dimensional family), we deduce that J mdx cannot be zero. Moreover, 
we also infer that ^ is independent of t, namely ^ is a constant. By Proposition IA.31 
we can choose m such that J mdx = 1. In conclusion, the last equality reads as 


^ ~ J dx 

for every 0 G L°°(P) (clearly, ^ depends on 0). By Lemma [A. 21 a standard applica¬ 
tion of the Kantorovich-Vulikh theorem (see, [231 Theorem 6.3] and the subsequent 
discussion) ensures that the semigroup associated to the Cauchy problem flA.lSp has 
a stricly positive integral kernel. Therefore, we may accomplish the proof following 
the same arguments of |3] and of [31 Lemma 2.3]. 

Finally, let us prove that m belongs to C^(P); £x j G J and rewrite the equation as 

ud'^m = —mdjb — bdjm (3.24) 

Since 6 G C'^(P) and m G iL^(P), it follows that m G iL^(P), hence djm is continuous. 
Therefore by fl3.24p we conclude that m G C'^(P) and it is also a strong solution to 

(1XT71) . □ 


3.3 Proof of Theorem 13.1 

Proof of Theorem 13.11 Consider the set /C = {/i G (^^’"(P) : J^^dx = 1} 
and observe that /C is a closed subset of the Banach space C°’"(P). We define an 
operator T : /C ^ /C according to the scheme 

/i —)■ M ^ m (3.25) 

as follows. Given /i G /C, we solve the problem fl3.8p - fl3.9p with f{x) = K[/i](a;) for the 
unknowns u and p, which are uniquely defined by Theorem 13.21 Then, for u given, 
we seek a function m which solves problem fl3.17p - fl3.18p with b{x) = dpH{x,du). 
By Theorem 13.31 the function m is univocally dehned and we set m = T{p). We 
claim that 

the map T is continuous with compact image. (3.26) 

Let pn, P G /C be such that \\pn — p\\c°’‘^ —)■ 0 for n —)■ oo and let {un,Pn), {u, p) 
be the solutions of fl3.8p - fl3.9p corresponding to /(•) = V{pn{-)) and, respectively. 
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/(•) = y(/i(-)). By the estimate fl3.10p . (possibly passing to a subsequence) 
converges in C^(r) to a function it and pn converges to some constant p. Since 
V[pn\ —t V[p\ in and since the transition and the boundary conditions pass to 
the limit by the C'^-convergence we get that h is a solution of fl3.8p - fl3.9p with f{x) 
and p replaced respectively by V[m][x) and p. By the uniqueness of the solution 
to fl3.8p - fl3.9ll we get that u = u and p = p] moreover, all the sequence {{un, Pn)} 
converges to {u,p). Let and m be respectively the solutions of fl3.17p - fl3.18ll 
with / = 0 for 6 = dpH{x,dun) and for b = dpH{x,du). By the estimate fl3.20p . 
the functions are equibounded in H^(T). Since dpH{x, dun) uniformly converges 
to dpH{x,du), passing to the limit in the weak formulation yields that (possibly 
passing to a subsequence) converges to a solution m to fl3.17p - fl3.18p with b{x) = 
dpH{x, du). Theorem l3.3l entails: m = fh; hence, the whole sequence {m„} converges 
to m. 

To prove the compactness of the image of T, consider a sequence pn such 
that ||/in||cO'“ < 1 and let and nin the functions obtained according to the 
scheme fl3.25p . By fl3.10p . ||M„|lc 2 ,a is uniformly bounded and therefore by fl3.20p 
also 11 11 ( 70,0 is uniformly bounded. As in the proof of Proposition 13.31 we get an 

uniform bound on the i7^-norm of for any n. By the compact immersion of 
in we get that the sequence is compact in and therefore in 

(7°’". Hence, claim fl3.26p is completely proved. 

We can therefore conclude by the Leray-Schauder hxed point Theorem that 
the map T admits a hxed point , i.e. a solution of system fl3.6p . Moreover this 
solution is also smooth by the regularity results in Theorems 13.21 and 13.31 

Finally the uniqueness of the solution to fl3.6p under the assumption fl3.7p 
follows by a standard argument in MFG theory adapted to the networks (see ESI). 
We assume that there exists two solutions {ui,mi,pi) and {u 2 ,m 2 ,P 2 ) of fl3.6p . We 
set h = Ml — M 2 , m = mi — m 2 , p = pi — p 2 and we write the equations for u, fh 

—vd'^u + H{x, dui) — H{x, du 2 ) + p — (H[mi] — V[m 2 ]) = 0 
1'd‘^fn + d{midpH{x, dui) — m2dpH{x, du2)) = 0 
^ ^Au{vi) = 0 

T^jeinci I'jdjAvi) + {midpH{vi, dui) - m2dpH{vi, du2)) = 0 
Jp fhdx = 0, /p udx = 0 

Multiplying the equation for m by w and integrating over ej, we get 



(rnidpHj{x, dui) 


m2dpHj{x,du2))dju{x)~\ dx 


+ 


Ujiyjdjm + midpHj{x, dui) 


m2dpHj{x, du2)) 


0 . 


Multiplying the equation for w by m and integrating over Cj, we get 


(3.27) 


Ujdjudjm + [Hj{x, djUi) — Hj{x, djU2) + p — (H[mi] — V[m2])]mjdx 


(3.28) 


+ 


UjindjU 


= 0 
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Adding fl3.27p to fl3.28l) . summing over j G J, regrouping the terms corresponding 
to a same vertex Vi and taking into account the transition and the normalization 
conditions for u and rh we get 


— m2)(y[mi] — V[m2\)dx+ 

jej dej 

/ mi [Hj{x, djU2) — Hj{x, djUi) — dpHj{x, djU2)dj{u2 — Ui)\dx+ 
jej dej 



djUi) — Hj{x, djU2) — dpHj(x, djUi)dj{ui — U2)]dx = 0 . 


Since each of the three terms in the previous identity is non-negative, it follows that 
it must vanish. By 03.71) we get mi = m 2 . By the uniqueness of the solution to 03.81) 
we dually get Ui = U 2 and pi = P 2 - n 


A Appendix 


A.l Auxiliary results for HJB equation 

In this section, we study the following semilinear problem 

{ —h>d‘^u + H{x, u, du) -I- Au = 0, x G F 

Uj{vi) = Uk{vi), ^ Vjdju{vi) = 0 j, fc G Inci, Vi G V. 

j^Inci 


(A.l) 


As far as we know, this problem has not been tackled before; we shall establish 
existence, regularity and uniqueness (via comparison principle). 


Definition A.l 


(i) A strong solution of OA.ip is a function u G C^(r) which satisfies OA.ip in 
pointwise sense. 

(a) A weak solution of OA.ip is a function u G H^{T) such that 


/ {i^jdjudj(() + H{x,u,dju)(j) + Xu(j))dx = 0 for any (f E (T) . (A.2) 

ieJ 


Remark A.l One can easily check that, if u E C^(r) is a weak solution of OA.ip . 
then it is also a strong solution. 

Let us now state our existence result 
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Proposition A.l Assume 


Hj{-,r,p) is measurable in x, for any (r,p) G M x R and ,. . 

H, {x, •, •) is continuous in {r,p), for a.e. x G (0,/j) ^ 

\H{x,r,p)\ < Co + b{\r\)\p\‘^ for a.e. (x,r,p) G F x R x R (A.4) 

H{x,r,p) is not decreasing in r for a.e. (x,r,p) G F x R x R (A.5) 

A > 0, z/j G R with 0 < z/q := inf i/j (A.6) 


where Co > 0, 6 : R —)■ R zs an increasing function. Then there exists a weak 
solution to flA.lD . Moreover 

||'u||/fi < C 

with C depending on Cq, A and vq. 

Moreover, if H belongs to C°’"(F x R x R) for some a G (0,1), then solution 
u belongs to C^’"(F) with 


||'n||c'2’“ ^ Ci(l + llnll//!) 

where Ci is a constant depending only on Co, b and uq. 
Lemma A.l Assume flA.3p . flA.Sp and, for some Ch > 0, 
\H{x,r,p)\ < Ch for (x,r,p) G F x R x 
Then there exists a weak solution u to flA.ip . Moreover 

Ch 


(A.7) 


\u\ 


< 


A 


(A.8) 


Proof Define a map T : i/^(F) —)■ H^iT) by taking the weak solution u = T{v) 
of 

—h'd'^u + Xu = —H{x, V, dv) a: G F 

Uj{vi) = Uk{vi), ^ Vjdju{vi) = 0 j,k e Inci, Vi G V. 

j£lnci 


(note that existence of a weak solution to flA.9p follows by the theory of sesqui-linear 
forms, see for instance m). Standard estimates implies that T is continuous with 
compact image, hence by the Schauder’s Theorem it admits a hxed point which is 
a weak solution to flA.ip . 

Even though the proof of estimate flA.SD is standard, for completeness we 
sketch the argument. Let G : R —)■ R be a smooth function such that G{t) = 0 
for t G (— cxo,0] and G strictly increasing for t G (0, cxd). Set K = Ch/X and 
cf) = G{u — K). Then cf G H^{T) and by taking 0 as test function in flA.2p we get 


0 = f [uj{djuyG'{u—K) + {Hj{x,u,dju) + XK)G{u—K) + X{u—K)G{u—K)]dx 

T J Ea 


jej 
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Since Hj{x, u, du) + XK > 0 and G{u — K) >Q a.e. on F, then 

f X{u — K)G{u — K)dx < 0. 

jGJ 

and by tG{t) > 0 for t G M, it follows that {u — K)G{u — K) = 0 a.e. on F, hence 
u < K a.e. in F. □ 


Proof of Proposition IA.1I The proof of the existence resnlt follows exactly 
the same argnment of the proof of [SI Theorem 2.1] replacing their steps 1 and 2 
with Lemma lA.ll In fact, in the weak formulation of fid.lip . given in Dehnition 
lA.ll the transition condition is transparent and the estimates necessary to prove 
the result are obtained using the weak formulation flA.2p which is the same of the 
problem posed in an Euclidean domain. 

Consider now H e C'°’"(F x M x M). We already know that u G C°(F) and we 
have only to show that Uj G Ij) for any j E J (recall that Uj is the restriction 

of u to the edge ej). For j hxed, the equation for u (in distributional sense) is 


— = —Xuj — H{x, Uj, dju) in (0, Ij). 


(A.IO) 


Since Uj G C'°([0,/j]) and, by flA.4p . H{-,Uj{-),dju{-)) G L^((0,/j)), by flA.lOp we 


immediately get Uj G kF^’^((0, /j)) and therefore djU G L^((0,/j)), for any p > 1. 
We deduce dju{-)) G L^((0, /j)) and in particular uj G kF^’^((0, Ij)). Hence 

djU G C°’"((0, Ij)) and again by flA.lOp we get the statement. Moreover, the estimate 
flA.711 easily follows from (lA.lOD . □ 


Proposition A.2 Assume flA.311 and flA.5D - flA.6D . Let the functions Ui,U 2 G C'^(F) 
satisfy 

{ —ud'^ui + H{x, Ml, dui) + Ami > —i'd‘^U 2 + H{x, U 2 , du 2 ) + Xu 2 a; G F 

< E,e/nc, VjdjU^Ui) V, 6 V. 

(A.ll) 

Then, Ui > U 2 on F. 

Proof We argue by contradiction assuming maxr(M 2 — Ri) =: 5 > 0. Let xq be 
a point where U 2 — Mi attains its maximum. The point xq either belongs to some 
edge or it is a vertex. Assume that xq belongs to some edge Cj. By their regularity, 
the functions Mi and M 2 fulhll 

M2(xo) = Mi(xo) + 5, djU2{xo) = djUi{xo), 9|m2(xo) < djUi{xo). 

In particular, we deduce 

- z/jcI|mi(xo) + H{xo,ui{xo),djUi{xo)) + Ami(xo) 

< -UjdjU2{Xo) + iF(Xo,M2(Xo),<9jM2(Xo)) + A(m2(Xo) - 
< -UjdjU 2 {xo) + H{xo,U 2 {xo),djU 2 {xo)) + Am 2 (xo) 
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which contradicts the hrst relation in flA.lip . Assume that Xq = Vi for some n, G 
V. Being regular, the functions Ui and U 2 fulhll djU 2 {vi) < djUi{vi). We claim 
djU 2 {vi) = djUiivi) for each j G Jncj. In order to prove this equality we proceed 
by contradiction and we assume that djU 2 {vi) < djUi{vi) for some j G Inci. In this 
case we get ^j9jU2{vi) < J2-ieinci ^jdjUi{vi) which contradicts the second 

inequality in flA.lip : therefore, our claim is proved. Moreover, since Ui{vi) = U 2 {vi) — 
6 , we deduce 


H(vi, ui(vi), djui(vi)) + Aui(vi) = U2(vi) - 6, djU2{vi)) + X{u2{vi) - 5 ) 

< H{Vi,U2{Vi),djU2{Vi)) + Xu2{Vi). 

Taking into account the regularity of H and of Ui {i = 1,2), we infer that in a 
sufficiently small neighborhood Bnivi) there holds 

H (x, Ui{x), dui{x)) + Ami(x) < H{x, U 2 {x), du 2 {x)) + Xu 2 {x). 

This inequality and the hrst relation in flA.lip entail 


i'jd‘j{u2-ui){vi) > H{vi,U2{vi),djU2{vi)) - H{x,ui{vi),djUi{vi)) 

+ X{u 2 {Vi) - Ui{Vi)) > 0 

which, together with djU 2 {vi) = djUi{vi), contradicts that U 2 —U 1 attains a maximum 

in Xq = Vi- □ 


A.2 Auxiliary results for the Fokker-Planck equation 

Proposition A. 3 Assume that f G (^“(r) and b G C'^(r). The problem 03.17p with 
/ = 0 admits a unique (up to multiplicative constant) weak solution. Moreover, for 
/ 7 ^ 0 , the problem has a solution provided that Jp fdx = 0 . 

Proof We shall proceed following the technique of pTl Theorem 2.2] and of 
Theorem II.4.2]. To this end, it is expedient to introduce the following forms on 
H\Ty. 

a{u,v) / {ujdjudjV + ubjdjv) dx, {u,v) / UjVjdx. 

jeJ jgj 

We observe that, for s > 0 sufficiently large, the form 


as{u, v) := a{u, v) + s{u, v) 

is coercive on Actually, the regularity of b entails 

as{u,u) > [^jidjuf + su‘^j - \\b\\,^\ 

j&J 


(A.12) 


- ^ . 

j&J "'O L 


-{djuf + s 


dx 

dx. 
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Fix s > 0 such that is coercive on Invoking Lax-Milgram theorem, we 

obtain that for every / G -h^(r), the problem 

as{u,v) = {f,v) \/v e H^{T) (A.13) 


has exactly one solution u =: Gs(/)- In other words, there exists a map Gg ■ 
L^(r) —)■ Ff^(r) such that Gs{f) is the unique solution in of problem flA.lSp . 

In fact we claim that 

Ggif) e H\T) V/ e L^{T). 

Actually, let us observe that, on each edge ej, the weak formulation of problem 
fl3.17p is equivalent to the equality (in distributional sense) 

UjdjTn = / + dj{bm) 

where the right-hand side is in L‘^{ej). Whence, m G H‘^{ej) for every j & J and our 
claim is completely proved. Let us observe that the weak formulation is equivalent 
to 

{I-sGg){u) = Gg{f) mL\T)- 

indeed, the weak formulation can be written as: as{u,v) = (/,n) -1- s{u,v); hence 
u = Gs{f)+sGs{u). We observe that, by the Rellich-Kondrachov theorem (see [21]), 
Gg maps compactly L^(r) into itself. By Fredholm alternative, the existence and 
the uniqueness of our problem are related to the properties of the operator {I — sG*) 
where G* is the adjoint operator of Gg. 

Let us now calculate G*. To this end, it is expedient to introduce the problem 
(s > 0 is the same as before) 


j sw — ud'^w + h{x)dw = h x G F 

\ Wj{vi) = Wk{vi), J2jeinci ^jdjm{vi) = 0 n* G V, j, fc G Irid 


(A. 14) 


whose weak formulation is 


/ {i^jdjwdjV -|- bjdjwv -f swv) dx = 


j&J 


j&J ' 


hjvdx 


\/v G 


Arguing as before, we infer that there exists a compact map Gg : L^(F) —)■ iL^(F) 
such that Gs{h) is the unique weak solution to problem flA.ldp . 

We claim that G* = Gg. In order to prove this claim, it suffices to show that 
there holds {Gs{f),h) = {f,Gs{h)) for every f,h E L^(F). For m := Gg{f) and 
z := Gg{h), the regularizing effect of Gg and Gg ensures 


{f,Gg{h)) = 




[sm — UjdjTn — d{bm)]z dx 


3 


/ [smz + VjdjmdjZ + bradjz\dx = / mhdx= / Gg{f)hdx 


where the third equality is due to the Kirchhoff condition in fl3.17p . while the last two 
equalities are due respectively to the weak definition of flA.ldp and to the definition of 
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m. Hence, we accomplished the proof that Gg is the dual of Gg- Therefore, invoking 
Fredholm alternative, we infer that the dimension of the kernel of (/ — sGg) is hnite 
and it coincides with the one of the kernel of (/ — sGg). in order to evaluate the 
latter, we observe that it is the space of the weak solution to flA.ldj) with h = 0 and 
s = 0. For this problem. Theorem [2ll Theorem 2.1] ensures the maximum principle 
and in particular that every solution is constant. Therefore the kernel of (/ — sGg) 
is one-dimensional and the hrst part of the statement is completely proved. 

In conclusion, still Fredholm alternative guarantees 


Rg{I - sGg) = Ker{I - sG] 


\-L. 


in particular, problem fl3.17p has a solution provided that / is orthogonal to a one¬ 
dimensional space. Using 0 = 1 as test function in fl3.19p . we obtain the desired 
compatibility condition for the solvability of the problem. □ 


Lemma A.2 For every 0 G T^(F), the parabolic Cauchy problem 


^ dtU - ud'^U + hdU = t) 

PjdjU{t,Vi) = 0 

j^Inci 

Uj{t,Vi) = Uk{t,Vi) 

U{0, x) = 


in (0, -|-oo) X F 
Vi eV, t e (0, -|-cxd) 

Vi e V, j, k G InCi, t G (0, -|-cxd) 
on F. 


(A.15) 


admits exactly one weak solution. Moreover, for (f > 0, there holds: 

U{t, a:) > 0 V(t, x) G (0, -|-cx)) x F. 


Proof The existence and uniqueness of the solution are established in [291 The¬ 
orem 3.4]. For 0 > 0, the solution U is strictly positive in (0, -l-cxo) x F because the 
corresponding semigroup is holomorphic, positive and irreducible (see [12] or [2]). 
We observe that the positivity of the semigroup is a straightforward consequence 
of the comparison principle. Moreover, the semigroup is holomorphic because the 
form Og introduced in flA.12p is coercive (as established in the proof of Proposi¬ 
tion |A]3|). Finally, the irreducibility of the semigroup can be obtained following the 
same arguments of [T9l Proposition 5.2]. □ 


Remark A.2 Let us recall that estimates for the kernel function for problem flA.15D 
can be obtained arguing as in mw- 
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